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TblB  paper  iatcodeees  a  aa«  Itarative  laaga 
rastocatlae  Mthed  ehlea  to  eapaOle  oC  teetorlag 
nolsp,  blerced  toeges  bp  Ineorpetatiag  a  priori 
kaovleage  about  the  toapa  aaS  aolae  atatiattea 
late  the  iterative  prooaOere. .  the  itaratiea 
egaatlee  eeeelete  oc  a  predict  toe  pact  ahlA  to 
baaed  ee  a  aaecaBaal  toaga  aadel  daaerlptiea  and 
an  laaeoattoe  part  ahtob  to  ealghted  hg  a  gala 
faebor...  9m  gala  to  ueegntad  ealag  a  llaaar  MR 
optlalaallaea^noadata  aad  to  apdatad  at  eaeli- 
atap  of  tba  Itaratiea.  9ila  toaga  ceatoratloa 
aeheaa  can  ba  laterpratad  aa  an  itecatiea  preee- 
dnra  with  a  atatlatleal  eenattaiat  an  tba  toaga 
data. 


Xa  aaap  ptaetleal  altoatiena,  tba  toaga 
degradation  can  be  adequately  aodelled  by  a 
linear  bloc  (aotton,  defoeuaalng,  ataaepbeclo 
tarbulenoa)  and  an  addltlee,  ehlte  Gauaalan  aolae 
ptooaaa  (II.  If  the  obaereed  toage  la  repte> 
aentad  by  an  NMI  array  of  teal  picture 
elanenta  (y(l,j)i  Itiei,  l<]ei),  then  In  tba 
apatlally  Invariant  eaae  It  can  be  deactlbad  by 
the  following  two^toaaalonal  (2*0)  eenvolatlon 
aiauMtleni 

yU,j)  ■  I  r  bto,n)*(l-a,J-n)^w(l,J) 

(B,a) re^ 

where  y(l,j)  to  the  degraded  toagai  B(l,j)  to  the 
otlgtoal  to age I  v(l,))  la  the  additive  ebaerva- 
tlen  neiae,  ubleh  la  aaauead  to  ba  Mieertelatad 
with  tba  toaga  datai  and  bto,n)  la  the  topulaa 
reaponaa  or  pelat>spread  function  (nri  of  tba 
toaglag  ayatan  that  la  intcedueing  the  blur,  it 
la  aaaeaad  that  tba  auppect  of  the  VSF,  M^,  la 
nuch  aeallac  than  tba  alaa  of  tba  toage. 


With  thto  nodal,  the  problee  of  toage  re- 
atoratlan  la  repceaented  aa  tba  problee  of 
operating  aa  the  dageadad  toaga  y(i,))  to  order 
to  get  an  toproved  toage  x(l,j)  whlab  la  aa  aloae 
tc  the  original  toage  a(l,j)  aa  poaelbla,  aUbjeat 
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to  a  aultabla  opttoallty  criterion  aad  gtona  aena 
prior  knowledge  about  the  PR  of  tba  blar,  tba  ^ 
toaga,  aad  tha  aolae  atatiatiea. 

Xnverea  fUtarlng  techniques,  which  ato  at  I  c 
parfeet  raatoratlon  of  tba  toaga  by  aatog  tba 
eonvolutlooal  laveraa  of  tha  bloc,  beeaea  poor 
ceatoratloa  taehnlqaaa  wbaa  aolae  la  pceaeat.  ^ 
fbla  eaa  alao  ba  tha  oaae  with  tha  class  aC  itar- 
atlva  ceatoratloa  algorlthes  thleh  ware 
latrodnoed  la  (2).  The  Itaratlva  techalquas, 
however »  do  have  advaatagaa  abea  oceyaaud  with 
tba  laveraa  filter,  aneb  as  tba  posslblXity  of 
laoorporatlng  phyaleal  eonstcalata  on  tha  data 
(2) ,  ean-naohlaa  Intacactlea  (31 ,  aad  tba  ability 
to  deal  with  non-llaaar  or  ahlft-varytog  bluca 
(2).  Tharafoca,  oonsldacabla  effort  has  been 
aspanded  In  trying  to  dtolnlab  tha  high  aolae 
eenalCivlCy  of  the  iteratlwa  proeedarea,  ahlto 
atlll  producing  reasonably  sharp  toages.  Of  tba 
different  prooadurse  propoaad  ao  far,  wa  aaatton 
bare  the  low-pasa  filtering  of  tba  obaaread  data 
prior  to  applying  a  constrained  Iterative  proow- 
dure  (4],  the  *reblncrlog*  procedure  (2),  ml  the 
use  of  sees  type  of  stopping  rule  baaed  an  tba 
error  residual  and  tha  variance  of  the  abasrva- 
tlon  noise  (S).  In  all  of  these  appcaaehes, 
however,  ao  atteept  baa  been  nada  to  Inoarporate 
statistical  knowledge  of  the  toage  and  tha  aolae 
directly  into  tha  restoration  acheae,  as  to  oea- 
aon  practice  with  Nlanar  and  Kalaan  flltara  and 
is  dona  la  tha  new  proposed  algorltha. 


Me  asauaa  that  the  orlgiaal,  undtotocted 
toage  oan  be  Interpreted  aa  a  saapla  fraa  a 
diserata,  beaogeneous  raadea  field  fa(l,3)i 
1<1MI,  Per  oonvenlanee  wa  will  seat 

that  the  naan  of  tba  toaga  has  been  asttoatod  aad 
subtractad.  For  a  dlsousslan  of  autoragiasslvu 
Bodals  for  toages  with  non-aero  naans  aaa  I<1.  . 
Dndat  these  asauaptlona  tha  orlgiaai  toaga  aU>J> 
eaa  be  aodelad  by  the  2*e  aatoragresslva  apMtloa 

*(1»3)  •  I  I  a(p,q)a(l-p»J-^)*BCl,JI  ,,, 
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olwt*  rtpicMnts  tb«  i»ag*  Intansity  «•!«• 
•t  spatial  coecdlaataB  (t,j)  and  wbara  can 
ba  viawad  as  aitbat  tha  input  pceeaaa  or  as  tba 
atrof  in  ganarating  sCitj).- 

Tha  Bbapa  of  tha  ragion  S  spacifias  that 
Boaa  saiplaB  of  s(iij)  oust  ba  ecaputad  batora 
otbars.  Causality t  bowavari  is  a  tiaa-daoaia 
eoneapt  which  has  no  Baaniag  <dian  talking  about 
tha  spatial  aatiablas  in  an  laaga.  laposing  an 
otdaring  ralation  on  tha  saaplas  is  unnatural  and 
should  ba  aroidad  if  possibla.  Tbaraforat  w* 
rastriet  oursalvas  to  tha  'class  of  non-eausal 
laaga  nodals  for  which 

8  ■  {(p«q)i  p*-*q*<p**  (p»q)*(0,0)}  (» 

In  this  easa,  tha  Inaga  ean  ba  saan  be  ba  a  saa- 
pla  froo  an  anlnotroplo  bcooganaous  •randco  flald 
that  satifias  a  neneausal  sbeehascie  diffarsoca 
aquation  t?].  Mota  that  with  this  dascription  wa 
naka  no  aaaunptiona  about  tha  saparability  os  tha 
axponantial  fon  of  tha  autocovarianea  funo> 
tion.  Also  nota  that  nnlika  eansal  ninlwai 
warianca  oodalSf  noneauaal  niniaua  warlanoa 
■odalSt  aca  not  driaan  by  whita  noiaa  (7]. 

Thera  arn  diffarant  approaehas  that  ean  ba 
followad  to  aKlaote  tha  paraMters  a(p,q)  of  aq. 
(2).  If  wa  haaa  a  aoiaa-fraa  unblurrad  prototype 
Image  tha  neneausal  aodal  eould  ba  fitted  to  tha 
•easurad  autoeewarianca  function  (undar  tha  aa- 
Biaaption  of  bonaganeity) ,  for  diffarant  aaloas 
of  p  by  using  a  linear  Nft  fitting  procodura. 
Mbieh  nodal  nltlnataly  saraes  to  daaeriba  tha 
inaga  data  wold  dapand  upon  sane  nodal  quality 
eritarion  (81.  In  tha  caaa  wa  haaa  noiay  inaga 
data«  we  could  naka  use  of  the  nodal  paranatar 
identification  pcceadura  daseribad  by  Kaufnan  at. 
al..  If]. 

yptnulatian 

Ciaan  tha  obsarastion  equation  (1),  rapra> 
santing  tha  noisy  blurred  inaga  data,  and  a 
neneausal  inaga  nodal  description  of  tha  original 
nndistortad  inaga  (2) ,  wa  propoae  the  following 
iterationi 


kg<it))  •  «•) 

a^d.J)  ■  (4b» 

(i,J)aV  (y(l,J)-b(i,J)*«i?^(i,3)  ] 

.  (4e) 

lata  a(i,3)  and  b<i,j)  result  fren  tha  inaga  and 
obsaraatien  nodals  raspeetieely,  k  denotes  the 
iteration  Indus,  and  ••  denotea  2-D  eoneolu- 
ties.  It  should  ha  noted  that  the  predicted 
signal  in  (4b)  and  tha  filtered  l  ctisI  in  (4e) 
are  truneatad  after  each  step  in  u-.  itaration  to 
the  site  of  tha  obserwad  inaga  p>:'. 


The  propesad  iteration  saans  to  ba  sinilar 
in  nany  respects  to  a  Kalnan  filter.  Contrary  to 
the  recur Siva  Kalnan  filter,  beweaar,  this  filter 
is  itaratiee  by  nature  dot  to  tbe  neneausal  inaga 
and  blur  dascription.  In  (10)  To  and  Kaufnan 
suggest  a  sinilar  aehans  for  restoring  noisy 
unblurrad  inagas.  They  report  inproaed  parfor* 
nance  ralatiaa  to  raeursiae  noiaa  aneothing 
algerithns. 

filter  Bain 

So  oenputa  tha  gain  1.  at  tha  kth  iteration 
in  (4),  wa  nininite  tha  qumtity 


J(l^)  -  K{(i^(i,J>-s(i,3)f  }  (5) 


The  resulting  optlnal  aalua  of  2.  ean  ba  stiewii  to 
ba  equal  to  * 


b(0.8) 


I  I  h'(n,a) 


(n,n) 


ill  0r<i.J)-b(l,3)**Sw(t.J>)* 


(•) 


wbata  is  the  aerianea  of  the  obsarastion 
noise  md  idtara  ia  the  nwber  of  pisals  in  the 
support  region  W  (11).  For  a  benogenaous  inaga 
tha  support  ragion  can  ba  taken  to  ba  the  idwle 
inaga,  but  tor  a  nenhenegaaoeas  inaga  it  would  ba 
a  Bubsaetioa.  If  a  window  is  used  to  linit  the 
support  region,  than  a  naw  nodal  and  a  now  gain 
should  be  conputed  for  awary  window  position. 
Tha  window  sisa  should  ba  larger  than  the  support 
of  tha  blur  but  snail  enough  ae  that  ewer  tha 
region  cewarad  by  the  window,  tha  blur  is  space- 
invariant. 


By  considering  limiting  cases,  tha  innova¬ 
tion  gain  ean  ba  shown  to  satisfy  tha  bounds 

c  *  1  t  — 

II  h*(n,n)  (7) 

(n,n) 

for  the  ease  of  linear  notion  blur  the  upper 
bound  will  ha  equal  to  one,  wbila  for  a  gaussian 
blur  it  nay  be  senewhat  larger. 


To  investigate  tha  eonvergenea  of  the  itern- 
tion  in  the  spatially  invariant  caaa,  wa  ban 
rewrite  (4)  in  the  frequency  denain. 


s 


Bar*  ft(M  ,kL)  la  tha  fraqaaney  taaponaa  of  tha 
ptaBletof  m  B(aL  ,iiC)  la  tha  ftaquaney  raaponaa 
of  tly  bloi.  8f  MlTlng  tha  Itaratlon  wa  saa 
that  >|((*^>*^)  can  ha  wrlttan  aa 

Td*,,!!,)  ♦  (*) 


Ing  aquatlona  for  tha  algor  ittM  and  tha  flltar 
gala  ara  rary  aiailar  to  tha  ooaa  glaan  hy  agua- 
tieaa  (4),  aod  (C),  [11].  For  an  ••nalghbor 
ayaaatzie  2-0  noncauaiA  pradletlon  nodal# 
hoaavar,  that  vat  naad  with  a  linaat  notion  blur 
glaan  by  aquation  (12),  tha  eonditien  Cot  conaar- 
ganea  la  naaat  aatlaflad,  thua  tablorring  la 
alwaya  naeaaaary.  Mora  ganarally#  eonaatganea  ia 
aaaurad  for  aaary  poaitlaa  raal  tranafar  funetlon 
of  tha  dlotortlog  ayatan  proaidad  that 
|X(u,,t^)|<1. 

teparlnantal  Baanlta 


Zf  na  aaaoaa  that 

Si  *  tot  all  k  >  B 

than  tho  ann  In  (9)  baoonaa  a  gaonattle  aatiaa 
uhteh  ooanaaBaa  If 

•'"“S' V '  “•‘•S' 

Zf  both  and  B(tL ,ic)  ara  knoon,  aqoatlon 

(10)  ptoaidM  a  naans  tat  Mtaminlng  aeeaptabla 
aalnas  of  1„.  Parthac  Inaight  Into  this  losoa 
night  ba  gauM  by  eoasldarlag  tha  tollowliig  1-0 

afp]  1.  * 


hn  arbitrary  inaga  lina  is  nodallad  by  tba 
tirst-ordac  autoragcassiaa  talatlan 


a(a)  •  a  s(ii-l)  ♦  a  s(nal)  ♦  a(n) 


(11) 


Ibis  iawga  lina  ia  than  eoirrolaad  with  a  aia^la 
linaar  notion  blur  of  tba  Com  ' 


b(B) 

Iban  tha  naeaaaary 


0«nC«-l 

etbarwisa 


(12) 


condition  for  eomrorganea  ia 
found  by  aubstituting  into  (10)  idiieb  raaulta  in 
tba  inaquallty 


,  .  *L  ,  ‘aa 

X  ♦  ^  *  •  iT^ 

ir  ^  Blntj) 

*  1 2a  eea  nf 


t-l 

»(=5^ 


(20) 


In  rig.  1#  tha  axpraaaieaa  fren  tba  left-  and 
right-band  sMas  of  this  inaquallty  ora  plettaf 
for  i  ■!#  a«.S,'  and  Lb7#14.  It  ohould  ba  aotaf 
that  ma  oonaarganoa  eonditien  ia  net  aatiaCiaf 
Cot  laid.  h  wgr  te  ovoreont  tha  oenaatganM 
pcqhlsMM  ib  the  aaeend  eaoa  it  to  uaa  tha.  cs- 
blarriag  ‘  prooadura  [2].  according  to  this 
pcoeadaco  tha  dagtadad  inaga  ia^  firat  oonaeluad 
with  tha  point  spraod  funetior  t  i-i,-]),  uharo  * 
doastas  tha  eonploa  eenjojat#.  Willa  this 
fartbac  dagradaa  tba  inagt  ^  it  -uaia-i-.cca  that 
tha  oaacaU  blur#  b(i#))**  '  -i.-j)  viU  haaa  a 
tool#  naanagatlua  tranafar  ’  rx  rasult- 


Baeauaa  of  tha  pralininary  natura  of  thia 
uork#  only  ona-dinanalonal  raaulta  ara  pra- 
oantad.  Bach  inaga  lina  ia  nodallad  by  tba 
firat-ordar  aoteragrasalua  ralation  daoeribod  by 
aquation  '(H).  fba  optinal  ualna  of  tha  eoaCfi- 
eiant  a  ia  found  by  nlninialng  the  aqnacad  aeroa 
batuaan  tba  noiaa-fraa#  blar-fraa  inaga  line  and 
tha  bast  ontput  of  tba  pradletion  nodal#  ouac  a 
uhola  lina.  thita  Qauaaiaa  neiaa  was  added  to 
tha  dtatertad  signal.  Tba  parComoaea  of  t)M 
flltar  uaa  aualnatad  by  naaaaclng  tha  inpcaamant 
in  aignal-te-noioa  ratio  (BBB)  aftac  k  itara- 
tiona#  aoeording  to  tba  Comola 


Sbb  "  ‘“’10 


MB  , 

I  I  ly(l#j)-*(i.l)j’ 

i»i  i»i 

I  I  Ia(l,3)-a(i#J))* 
i-1  j-1 


Figura  2  sheaa  tha  ranoval  of  a  Oausaloa  and  a 
linaar  notion  blur  for  tha  *girl*  inaga.  Ba- 
blurring  was  naad  for  tha  linaar  notion  easa.  Zn 
both  caaas  tha  signal  to  noisa  ratio  was  20dB. 
Tha  BHh  inproamanta  wara  l.fdB  for  tba  Baaasiai 
blur  and  T.2  dB  for  tba  notion  blur.  Battar 
raaulta  would  ba  axpaetod  if  a  trua  2-b  algoritkn 
wara  usod  which  eould  aaplelt  tba  aartleal  eorra- 
lation  batwaan  piaala. 

Dlaonaaion  id  Oowelnaiona 


As  nantienad  ia  tba  introduction  eno  of  tha 
adaaatagas  of  tha  Itaratiwa  preeaduta  is  tha 
possibility  of  ineerpetatlng  physioal  (possibly 
nonlinaar)  eonatraints  on  tba  rastoration.  la 
[2]  thaaa  oonatraiats  wars  aapraaaad  ia  tarns  of 
oparatora  wbieb  projaet  a  signal  onto  m  allow- 
abla  subsot  of  signals,  and  can  ba  iatarptatad  aa 
hard  eonatraints.  In  tha  now  algorittn  tha  asti- 
nation  part  ean  ba  Intarpratad  as  a  *aoft* 
statiatioal  eonstralnt.  Tha  ainilarity  la  fern 
batwaan  tha  two  nantioaad  itarations  nuggaata  tba 
poaalbility  of  hybrid  algorithns  whara  nonlinaar 
prodietora  ara  naad  ubioh  ineorporsta  both  phyai- 
oal  and  statiatioal  infomation. 

Tba  paefomanea  of  tha  now  stoehastie  itara- 
tlwa  algerithn  has  boon  eenparad  with  tbs 
paefomanea  of  tha  datarainistie  algotittM  of 
■ehafac  at.  al.  (21#  ia  tba  prasanea  of  noisa 
till,  fbr  high  BMls  tba  datamlnlstio  olgorithn 


4 


outperfocas  the  stochastic  one.  while  for  low 
SNSs  only  the  stochastic  algor Itha  converges.  It 
should  be  noted  that  the  rehlurrlng  procedure 
eliminates  the  noise  at  high  frequencies, 
resulting  In  an  Improved  perforaance  of  the  de¬ 
terministic  algorithm. 

Further  research  will  involve  experiaenta- 
tion  with  2-D  causal,  semi-causal,  non-cauaal 
linear  prediction  models,  use  of  shift-varying 
models  for  the  blur,  simultaneous  estimation  of 
the  gain  and  the  prediction  coefficients  at  each 
iteration  step  at  well  as  identification  of  the 
parameters  of  the  distorting  system. 
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Figure  1 :  Convergsnos  analyiit  for  motion  bhir. 
(a)  L-7 ,  a-.B .  X-1. ,  (b)  L-U .  S-.6 ,  X-1. 


(a)  (b) 


(e)  (d) 

Fieurr  ?  :  (a)  Noisy  Murrad  inMgt ;  Gau^isn  Mur,aL  dsv.*4 
MinpiR  .  SNR-20dB .  lb)  rastofod  imaot ;  improvamarw  in 
SNr','  !.9JB  .  (e)  noisy  Uurrad  image  :  motion  bhir ,  Lvf , 
reUiirring  ,  SNR*20dB  ,  Id]  lastorad  image  :  improeailiant 

in  SNF<»f.?.dB 


